System and method for providing cloud based user interfaces

ABSTRACT

Provided is a method and system for providing cloud based user interface (UIs) that may store video content and a UI resource in a storage separate from a server, and may control the video content and the UI resource to be synthesized at a subscriber terminal device, thereby significantly decreasing load of a UIs providing server. The method and system for providing cloud based UIs may provide consistent UIs to various set-top boxes and media devices and may easily perform a change and a test of UIs.

CROSS-REFERENCE TO RELATED APPLICATIONS

This is a National Phase of PCT/KR2014/012679, filed on Dec. 23, 2014and claims priority under 35 U.S.C. §119 to, Korean Application No. KR10-2014-0161814 filed Nov. 19, 2014, the entire contents of each ofwhich are incorporated by reference in their entirety.

TECHNICAL FIELD

The present invention relates to a system and method for providing cloudbased user interfaces (UIs) that enables a subscriber terminal device toreceive content and a UI resource from a storage separate from a remoteapplication server in response to a control command of the remoteapplication server, and to render the content and the UI resource.

RELATED ART

A current broadcasting environment including the technology developmenttrend and the business trend of pay broadcasting providers has beenswitched to be an Internet based broadcasting environment, or has beenevolved to be partially combined with a hybrid form.

Also, with the appearance of various smart CE devices, a mediaconsumption style has been diversified. With the appearance of newlydeveloped technology such as Hypertext Mark-up Language (HTML) 5technology or ultra high definition (UHD) technology, capitalrequirements such as a purchase of high performance set-top box (STB), areorganization of user interface (UI)/user eXperience (UX), adevelopment of a new service, and an upgrade of a head-end system,occur, which results in being a burden on pay broadcasting providers.

Pay broadcasting providers are making ceaseless efforts to develop atechnology that satisfies a varying trend of the times in order tosecure superiority in competition with existing pay broadcastingproviders or new media providers such as an over-the-top (OTT) provider,a Google TV, and an Apple TV.

Accordingly, pay broadcasting providers replace existing set-top boxeswith high performance models, additionally introduce an Internet basedservice, and add recommend, search, and personalization functions byanalyzing various user requests. Also, the pay broadcasting providersmake investments on photographing, an edition, an encoder, and networkequipment to apply a multi-screen technology enabling media consumptionin various devices and to provide a video of a UHD beyond a HD.

However, in replacing existing head end systems and set-top boxesprovided through large investments at a time, the pay broadcastingproviders are facing a difficult situation in terms of finance and time.That is, an existing broadcasting method uses a significantly largeamount of cost and time to provide a real-time broadcasting and a videoon demand (VOD) and other bi-directional services and requires greatcost burden in developing a service capable of satisfying a customerdemand.

Accordingly, on the rise was a need for a technology that may outperformthe aforementioned issues faced by pay broadcasting providers, maydeviate from a technical method of an existing uni-directionalbroadcasting environment, may maximally use an advantage of abi-directional broadcasting environment, and may provide consistentUI/UX to various set-top boxes and media devices. In addition, requiredis a technology for providing an Internet based service, for example,social, recommend, search, and personalization services, and easilyperforming a test and a change of UI/UX complex for each set-top boxmodel.

Due to the above necessity, technologies for providing UIs from a cloudbased server to a subscriber device have emerged. However, due to acharacteristic of a computing process of the cloud based server, issues,such as an increase in a bandwidth for processing a process of a serverand an increase in load of the server, have occurred.

In addition, when a session connection is not smooth due to acommunication failure between a cloud based server and a subscriberdevice, a seamless service may not be provided to a user.

PRIOR ART Patent Document

U.S. Patent Laid-Open Publication No. 2011/0296460 (2011.12.01), “METHODAND APPARATUS FOR PROVIDING REMOTE USER INTERFACE (UI) SERVICE”

U.S. Patent Laid-Open Publication No. 2013/0091525 (2013.04.11), “METHODAND APPARATUS FOR PROVIDING CLOUD-BASED USER MENU”

DESCRIPTION OF INVENTION Subjects

The present invention provides a system and method for providing cloudbased user interfaces (UIs) that enables a subscriber terminal device toreceive content and a UI resource from a storage separate from a remoteapplication server in response to a control command of the remoteapplication server and to render the content and the UI resource,thereby reducing development cost of an application directly connectedto introduction of a new service or service experience of a customer.

Also, the present invention provides a system and method for providingcloud based UIs in which a remote application server may not perform aprocess of acquiring content and a UI resource and combining theacquired content and UI resource, thereby significantly reducing load ofthe remote application server.

Also, the present invention provides a system and method for providingcloud based UIs that may provide consistent UIs to a subscriber devicewithout performing an application development, porting, and a test withrespect to different types of set-top boxes having differentspecifications, thereby achieving a quick service release and enhancinga customer satisfaction.

Also, the present invention provides a system and method for providingcloud based UIs that may provide a UI configurable even in a lowperformance subscriber terminal device, thereby reducing purchase costof a subscriber terminal device and service development cost.

Solutions

A remote application server according to an embodiment of the presentinvention includes: a state information collector configured to collectstate information about a subscriber terminal device; a control commandgenerator configured to generate a control command including at leastone of a rendering control command for controlling a rendering at thesubscriber terminal device with respect to at least one of content and auser interface (UI) resource and a terminal control command forcontrolling the subscriber terminal device, based on the collected stateinformation; and a controller configured to analyze the stateinformation received from the state information collector, to transferthe analyzed state information to the control command generator, and tocontrol a generation of the control command.

The subscriber terminal device may be configured to receive therendering control command from the command generator over a network, andto request a media storage storing the content and the UI resource totransmit at least one of the content and the UI resource in response tothe received rendering control command.

The subscriber terminal device may be configured to extract a local UIresource from a local UI storage within the subscriber terminal devicein response to the received rendering control command, and to render atleast one of the content and the UI resource and the extracted local UIresource.

The subscriber terminal device may be configured to receive the terminalcontrol command from the command generator over a network, and toperform at least one of a terminal initialization, a software upgrade,and a session connection and a session block in response to the receivedterminal control command.

The state information may include at least one of resolution informationof a display device interacting with the subscriber terminal device,display screen rotation information, device information of an inputdevice interacting with the subscriber terminal device, and servicesubscription information. The subscriber terminal device may beconfigured to generate the state information and to transmit thegenerated state information to the state collector in response to astate information request received from the state information collector.

A subscriber terminal device according to an embodiment of the presentinvention includes: a state information generator configured to generatestate information in response to a state information request receivedfrom a remote application server; a resource receiver configured torequest a media storage for at least one of a UI resource and content,and to receive at least one of the UI resource and the content inresponse to the request; and a renderer configured to control a requestto the media storage in response to a control command received from theremote application server, and to receive and render at least one of thecontent and the UI resource from the resource receiver.

The subscriber terminal device may further include a local UI storageconfigured to store and manage a local UI resource. The resourcereceiver may be configured to receive the local UI resource from thelocal UI storage and to transfer the received local UI resource to therenderer.

The renderer may be configured to control the local UI resource to beextracted from the local UI storage in response to the control command,and to render at least one of the received content and the received UIresource and the extracted local UI resource.

The state information generator may be configured to generate the stateinformation corresponding to a user input received through an inputdevice.

A method of providing cloud based UIs according to an embodiment of thepresent invention includes: collecting state information about asubscriber terminal device; analyzing the collected state information;and generating a control command including at least one of a renderingcontrol command for controlling a rendering at the subscriber terminaldevice with respect to at least one of content and a UI resource and aterminal control command for controlling the subscriber terminal device,based on the collected state information.

A method of providing cloud based UIs according to another embodiment ofthe present invention includes: generating state information in responseto a state information request received from a remote applicationserver; receiving a control command corresponding to the stateinformation from the remote application server, and controlling arequest to a media storage for at least one of a UI resource and contentin response to the received control command; and rendering at least oneof the content and the UI resource associated with the request.

Effects of the Invention

According to embodiments of the present invention, a subscriber terminaldevice may receive content and a UI resource from a storage separatefrom a remote application server in response to a control command of theremote application server and may render the content and the UIresource, thereby reducing development cost of an application directlyconnected to introduction of a new service or service experience of acustomer.

Also, according to embodiments of the present invention, a remoteapplication server may not perform a process of acquiring content and aUI resource and combining the acquired content and UI resource, therebysignificantly reducing load of the remote application server.

Also, according to embodiments of the present invention, it is possibleto provide consistent UIs to a subscriber device without performing anapplication development, porting, and a test with respect to differenttypes of set-top boxes having different specifications, therebyachieving a quick service release and enhancing a customer satisfaction.

Also, according to embodiments of the present invention, it is possibleto provide a UI configurable even in a low performance subscriberterminal device, thereby reducing purchase cost of a subscriber terminaldevice and service development cost.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating a system for providing cloudbased user interfaces (UIs) according to an embodiment of the presentinvention.

FIG. 2 is a block diagram illustrating a configuration of a remoteapplication server and a subscriber terminal device of a system forproviding cloud based UIs according to an embodiment of the presentinvention.

FIG. 3 is a flowchart illustrating a process of providing cloud basedUIs through a control command between a remote application server and asubscriber terminal device according to an embodiment of the presentinvention.

FIG. 4 is a flowchart illustrating a process of providing cloud basedUIs through a remote application server in a system for providing cloudbased UIs according to an embodiment of the present invention.

FIG. 5 is a flowchart illustrating a process of providing cloud basedUIs through a subscriber terminal device of a system for providing cloudbased UIs according to an embodiment of the present invention.

DETAILED DESCRIPTION TO CARRY OUT THE INVENTION

Hereinafter, embodiments of the present invention will be described indetail with reference to the accompanying drawings and contentsdescribed therein, however, the present invention is not limited theretoor restricted thereby.

The terminology used in the present specification is to explain theembodiments and is not to limit the present invention. In the presentspecification, unless particularly described in the sentence, a singularform may also include a plural form. The term “comprises/includes”and/or “comprising/including” used herein does not exclude the presenceor addition of at least one another constituent element, step,operation, and/or device with respect to the described constituentelement, step, operation, and/or device.

The terms “embodiment”, “example”, “feature”, “instance”, and the likeused herein should not be interpreted as that a described predeterminedaspect or design is excellent or advantageous compared to other aspectsor designs.

Also, the term “or” indicates “inclusive or” rather than “exclusive or”.That is, unless differently described or unless clearly described in thecontext, the expression that “x uses a or b” indicates any one ofnatural inclusive permutations.

Also, a singular expression “a” or “an” used in the presentspecification and the claims should be interpreted to generally indicate“at least one” unless described otherwise or unless clearly described asa singular form in the context.

Also, the terms “first”, “second”, and the like used in the presentspecification and the claims may be used to describe various constituentelements. However, the constituent elements should not be limited by theterms. The terms may be used to distinguish one constituent element fromanother constituent element.

Unless differently defined, all the terminologies used in the presentspecification, including technical and scientific terms, may be used asmeanings that may be commonly understood by those skilled in the art.Also, the terms defined in a generally used dictionary should not beidealistically or excessively interpreted unless particularly clearlydefined.

When it is determined detailed description related to a related knownfunction or configuration they may make the purpose of the presentinvention unnecessarily ambiguous in describing the present invention,the detailed description will be omitted here. Also, terminologies usedherein are defined to appropriately describe the embodiments of thepresent invention and thus may be changed depending on a user, theintent of an operator, or a custom. Accordingly, the terminologies mustbe defined based on the following overall description of thisspecification.

FIG. 1 is a block diagram illustrating a system for providing cloudbased user interfaces (UIs) according to an embodiment of the presentinvention.

Referring to FIG. 1, the system for providing cloud based UIs accordingto an embodiment of the present invention includes a remote applicationserver 100 and a subscriber device 200.

The remote application server 100 analyzes state information of asubscriber terminal device 210, generates a control command based on theanalyzed state information, transmits the control command to thesubscriber device 200, and controls the subscriber terminal device 210or controls a rendering at the subscriber terminal device 210 withrespect to at least one of content and a UI resource in response to thecontrol command.

In detail, the remote application server 100 collects the stateinformation of the subscriber terminal device 210 within the subscriberdevice 200 over a network 300, and generates a control command forcontrolling a rendering at the subscriber terminal device 210 withrespect to at least one of the content and the UI resource based on thecollected state information.

Also, the remote application server 100 may also generate a controlcommand for controlling the subscriber terminal device 210 itself.

The remote application server 100 transmits the generated controlcommand to the subscriber device 200 over the network 300.

The state information according to an embodiment of the presentinvention may be information associated with the subscriber terminaldevice 210 when the subscriber terminal device 210 performs apredetermined function in response to the control command received fromthe remote application server 100.

For example, the state information may include at least one ofresolution information of a display device 230 interacting with thesubscriber terminal device 210, display screen rotation information,device information such as an input device 220 interacting with thesubscriber terminal device 210, and service subscription information.

The state information may be generated from the subscriber terminaldevice 210 together with session connection information in response to asession connection between the remote application server 100 and thesubscriber terminal device 210, and may be transmitted to the remoteapplication server 100. Also, the state information may be generatedfrom the subscriber terminal device 210 in response to a user input andmay also be transmitted to the remote application server 100.

The remote application server 100 of the present invention may be a headend system or a cloud based media providing server, and may receive anapplication for providing a service from an application storage 510 andmay also receive data such as subscriber information, media information,and social network related information from a data storage 520.

The subscriber terminal device 210 within the subscriber device 200performs a function of the subscriber terminal device 210 itself orreceives at least one of content and a UI resource from a contentstorage 410 and a UI resource storage 420 separate from the remoteapplication server 100 over the network 300 and renders the received atleast one of content and the UI resource, in response to the receivedcontrol command.

The subscriber terminal device 210 receives the control command from theremote application server 100, and requests a media storage 400 totransmit media such as the content and the UI resource in response tothe received control command. The media storage 400 may include thecontent storage 410 and the UI resource 420 based on a type or a form ofstored media.

In detail, in response to the received control command, the subscriberterminal device 210 requests the content storage 410 to transmit contentand receives the content from the content storage 410, and requests theUI resource storage 420 to transmit the UI resource and receives the UIresource from the UI resource storage 420.

In response to the control command received from the remote applicationserver 100, the subscriber terminal device 210 renders at least one ofthe received content and UI resource.

Depending on embodiments, in response to the control command, thesubscriber device 200 may request or receive content through a contentchannel formed with the content storage 410, and may request or receivea UI resource through a UI resource channel formed with the UI resourcestorage 420.

The UI resource may be configured using at least one of a webpage, abitmap of an application, and a graphic primitive of the application.

Depending on embodiments, the UI resource may include a user interfacefor receiving an external user command to control a provider service andthe subscriber device 200.

The subscriber device 200 may include the subscriber terminal device210, the input device 220, and the display device 230. As illustrated inFIG. 1, at least one subscriber devices 200 may be provided.

The subscriber terminal device 210 of the present invention may be anelectronic device equipped with a wired/wireless communication modulesuch as a set-top terminal (STT), a set-top box (STB), a communicationterminal, a personal computer (PC) a mobile communication terminal, asmartphone, a note pad, a personal digital assistant (PDA), and a tabletPC. Further, the subscriber terminal device 210 may be a terminal devicecapable of connecting to and thereby communicating with at least one ofthe remote application server 100, the content storage 40, and the UIresource storage 420 over the network 300.

Depending on embodiments, the subscriber terminal device 210 may also bea terminal device capable of performing signal processing, a bandwidthcontrol process, and a graphics processing process.

In detail, the subscriber terminal device 210 may be a terminal devicethat performs a graphics processing process such as receiving anddecoding MPEG-2 transport stream about content including video contentand audio content, and rendering the decoded content.

Also, the subscriber terminal device 210 may render a local UI resourcethat is stored and thereby maintained in the subscriber terminal device210, and received media, for example, the received UI resource andcontent, and may provide a user with a function such as an electronicprogram guide (EPG), a video on demand (VOD), and a digital videorecorder (DVR).

The input device 220 may be a device capable of receiving an input fromthe user, such as a remote controller, a keyboard, and a touch screendevice.

The subscriber terminal device 210 may receive an interactive user inputbased on bi-directionality about the content and the UI resourcerendered and provided from the input device 220 through the displaydevice 230.

For example, the user input may include various signals such as a streamrequest, a session initialization, and a clickstream.

Depending on embodiments, the subscriber terminal device 210 may alsodirectly render a resource corresponding to a user input, withoutdepending on a control command from the remote application server 100based on a type of the user input received through the input device 220.

For example, when the user input is reprocessed to be suitable for acurrent resource state provided to the user, a transmission of stateinformation to the remote application server 100 may not be requiredduring a resource reprocessing process. That is, the subscriber terminaldevice 210 may also directly process the resource in response to theuser input received through the input device 220.

The display device 230 may be a device that provides the user withcontent and the UI resource through a visual sense and an auditorysense, such s a TV, a computer monitor, a communication monitor, and asmartphone display.

The content storage 410 may store and maintain content, such as videocontent, audio content, a real-time TV broadcasting program, a programon demand, social networking service (SNS) information, a chat message,a product, and an application.

Depending on embodiments, the content storage 410 may also store contentof a format corresponding to a predetermined protocol such as an MPEG-2transport packet, an MPEG-4, and a digital video broadcasting (DVB), orcontent to which a predetermined protocol is not applied.

As another example, the content storage 410 may also store contentdivided using a predetermined method.

When content is real-time broadcasting content, the remote applicationserver 100 may control the content storage 410 to acquire broadcastingcontent, to divide the acquired broadcasting content using apredetermined method, and to store the divided broadcasting content. Inthis case, the content storage 410 may separately store and managebroadcasting program guide information to acquire and store thebroadcasting content.

For example, when the remote application server 100 analyzes stateinformation of the subscriber terminal device 210 and the analyzed stateinformation indicates a reception standby state of divided and therebystored broadcasting content, the remote application server 100 generatesa control command for a transmission of divided and thereby storedbroadcasting content and transmits the control command to the subscriberterminal device 210.

The subscriber terminal device 210 receives the control command, and inresponse thereto, transmits a request for transmitting broadcastingcontent to the content storage 410. The content storage 410 may searchfor additional data of divided content, may extract at least one dividedcontent suitable for the received request, may synthesize the same, mayprocess the same as user content, and may transmit the processed usercontent to the subscriber terminal device 210.

Here, the content storage 410 may transmit corresponding content to thesubscriber terminal device 210 or another client device (not shown)using a download method or a streaming method.

Also, the content storage 410 may store at least one of broadcastingcontent, divided content, and user content in a cloud storage space, andmay seamlessly provide content so that content may be continuouslyplayed back between a plurality of client devices held by the user,which may be referred to as an N-screen service.

To this end, one of the remote application server 100 and the contentstorage 410 may separately store and manage a content playback historyfor each client device.

According to another embodiment, the remote application server 100 mayalso control the content storage 410 and the UI resource storage 420 totransmit corresponding different content and a UI resource to each of atleast one subscriber device 200 based on a variety of communicationprotocols.

That is, each of a first subscriber device and a second subscriberdevice may receive content and a UI resource using a different protocolmethod.

FIG. 2 is a block diagram illustrating a configuration of a remoteapplication server and a subscriber terminal device of a system forproviding cloud based Us according to an embodiment of the presentinvention.

The remote application server 100 according to an embodiment of thepresent invention may analyze state information of the subscriberterminal device 210, may generate a control command based on theanalyzed state information, may transmit the generated control commandto the subscriber terminal device 210, and may control the subscriberterminal device 210 or may control a rendering at the subscriberterminal device 210 with respect to at least one of content and a UIresource in response to the control command.

To this end, the remote application server 100 includes a stateinformation collector 110, a control command generator 130, and acontroller 120.

The state information collector 110 collects state information about thesubscriber terminal device 210.

The state information collector 110 transmits a state informationrequest signal to the subscriber terminal device 210 over the network300 to collect state information of the subscriber terminal device 210,and receives state information from the subscriber terminal device 210corresponding to the transmitted state information request signal.

The state information may be information associated with the subscriberterminal device 210 when the subscriber terminal device 210 performs apredetermined function in response to the control command received fromthe remote application server 100.

For example, the state information may include at least one ofresolution information of the display device 230 of FIG. 1 interactingwith the subscriber terminal device 210, display screen rotationinformation, device information such as the input device 220 of FIG. 1interacting with the subscriber terminal device 210, and servicesubscription information.

The state information may be generated from the subscriber terminaldevice 210 together with session connection information in response to asession connection between the remote application server 100 and thesubscriber terminal device 210 and may be transmitted to the remoteapplication server 100. The state information may be generated from thesubscriber terminal device 210 in response to a user input and may betransmitted to the remote application server 100.

Also, the state information may be information corresponding to the userinput received through an input device.

The control command generator 130 generates a control command includingat least one of a rendering control command for controlling a renderingat the subscriber terminal device 210 with respect to at least one ofcontent and a UI resource and a terminal control command for controllingthe subscriber terminal device 210, based on the collected stateinformation.

Also, the control command generator 130 transmits the generated controlcommand to the subscriber terminal device 210.

Also, depending on embodiments, the control command generator 130 mayalso generate a control command including an image required forrendering at the subscriber terminal device 210.

The controller 120 may analyze state information received from the stateinformation collector 110, may transfer the analyzed state informationto the control command generator 130, or may control a generation of thecontrol command.

Also, the remote application server 100 according to an embodiment ofthe present invention may further include a transport module 140configured to form a signal path with the subscriber terminal device 210associated with a state information request, a reception of stateinformation, and a transmission of the control command. The signal pathmay form a single path with a transport module 213 of the subscriberterminal device 210.

The remote application server 100 may efficiently control the subscriberterminal device 210 through the signal path of the transport module 140.

For example, the remote application server 100 may efficiently control alocal application installed in the subscriber terminal device 210 and anauthentication with the subscriber terminal device 210 through thetransport module 140.

In response to the control command received from the control commandgenerator 130, the subscriber terminal device 210 according to anembodiment of the present invention performs a function of thesubscriber terminal device 210 itself or receives at least one ofcontent and a UI resource from a media storage separate from the remoteapplication server 100 over the network 300 and renders the received atleast one of content and the UI resource.

The media storage may include a content storage and a UI resourcestorage based on a type or a form of stored media.

In detail, in response to the received control command, the subscriberterminal device 210 requests the content storage to transmit content andreceives the content from the content storage, and requests the UIresource storage to transmit the UI resource and receives the UIresource from the UI resource storage.

In response to the control command received from the control commandgenerator 130, the subscriber terminal device 210 renders at least oneof the content and the UI resource received from the media storage.

To this end, the subscriber terminal device 210 according to anembodiment of the present invention includes a state informationgenerator 211, a UI resource receiver 212, a content receiver 213, and arenderer 214.

The state information generator 211 generates state information inresponse to a state information request received from the remoteapplication server 100.

The state information may include information about a standby state of acontrol command from the remote application server 100, such as acontent reception standby state and a state requiring processing of auser input.

The resource receiver 212 requests the media storage for at least one ofthe UI resource and content, and receives at least one of the UIresource and the content in response to the request.

The UI resource may be configured using at least one of a webpage, abitmap of an application, and a graphics primitive of the application.

Depending on embodiments, the UI resource may include a user interfacefor receiving an external user command for controlling a providerservice and the subscriber terminal device 210.

In response to a UI command received from the control command generator130, the renderer 214 controls a request to the media storage, andreceives and renders at least one of the content and the UI resourcefrom the resource receiver 212.

The media storage including a content storage may store and maintaincontent, such as video content, audio content, a real-time TVbroadcasting program, a program on demand, SNS information, a chatmessage, a product, and an application.

Depending on embodiments, the media storage may also store content of aformat corresponding to a predetermined protocol such as an MPEG-2transport packet, an MPEG-4, and a DVB, or content to which apredetermined protocol is not applied.

As another example, the media storage may also store content dividedusing a predetermined method. When content is real-time broadcastingcontent, the content storage may acquire broadcasting content, maydivide the acquired broadcasting content using a predetermined method,and may store the divided broadcasting content.

In this case, the content storage may separate store and managebroadcasting program guide information to acquire and store thebroadcasting content.

The state information collector 110 of the remote application server 100receives state information from the state information generator 211.When the analyzed state information indicates a reception standby stateof divided and thereby stored broadcasting content as a result ofanalyzing the received state information by the state informationanalyzer 120, the control command generator 130 generates a controlcommand for a transmission request of the divided and thereby storedbroadcasting content and transmits the generated control command to therenderer 214.

The renderer 214 receives the control command and transmits a requestfor transmitting broadcasting content to the content storage in responseto the received control command. The content storage may search foradditional data of divided content, may extract at least one dividedcontent suitable for the received request, may synthesize the same, mayprocess the same as user content, and may transmit the processed usercontent to the renderer 214.

Here, the media storage may transmit the corresponding content to thesubscriber terminal device 210 or another client device (not shown)using a download method or a streaming method.

Also, the content storage may store at least one of broadcastingcontent, divided content, and user content in a cloud storage space, andmay seamlessly provide content so that content may be continuouslyplayed back between a plurality of client devices held by the user,which may be referred to as an N-screen service.

To this end, the remote application server 100 may separately store andmanage a content playback history for each client device.

The subscriber terminal device 210 according to an embodiment of thepresent invention may further include a local UI storage 215 configuredto store and maintain a local UI resource.

When the renderer 214 receives a control command for rendering a localUI resource from the control command generator 130, the renderer 214 mayrender a least one of the content and the UI resource and the local UIresource in response to the UI command received from the control commandgenerator 130.

In more detail, the resource receiver 212 may receive the local UIresource from the local UI storage 215 and may transfer the receivedlocal UI resource to the renderer 214. The renderer 214 may control thelocal UI resource to be extracted from the local UI storage 215 and mayrender at least one media of the local UI resource, the receivedresource, and the content, in response to the control command.

The local UI resource may be a user interface frequently interactingwith the user and requiring a quick responsiveness. For example, thelocal UI resource may be a UI resource corresponding to an EPG. The EPGmay display schedules of a broadcasting program on a display screen. Auser, for example, a viewer may select a desired program through theEPG, or may search for a desired program through a standard such as atime, a title, a channel, and a genre, using the subscriber terminal200.

On the contrary, the UI resource stored and maintained in the UIresource storage may be a user interface that is infrequently used bythe user or is beyond the performance of the subscriber terminal device210.

Depending on embodiments, the renderer 214 may also directly render aresource corresponding to a user input, without depending on a controlcommand from the remote application server 100 based on a type of theuser input received through an interaction with the state informationgenerator 211.

For example, when the user input is reprocessed to be suitable for acurrent resource state provided to the user, a transmission of stateinformation to the remote application server 100 may not be requiredduring a resource reprocessing process. That is, the renderer 214 mayalso directly process the resource in response to the user input throughan interaction with the state information generator 211.

Also, the subscriber terminal device 210 may further include thetransport module 213 configured to form a signal path with the remoteapplication server 100 associated with the control command and resourcesincluding a session access, state information, a UI resource, andcontent. The signal path may be a single path.

The remote application server 100 may efficiently control the subscriberterminal device 210 through the signal path of the transport module 213.

In more detail, the remote application server 100 may more efficientlycontrol a local application installed in the subscriber terminal device210, and may easily provide an addition and a change of a service to thesubscriber terminal device 210 through the transport module 213.

FIG. 3 is a flowchart illustrating a process of providing cloud basedUIs through a control command between a remote application server and asubscriber terminal device according to an embodiment of the presentinvention.

Referring to FIG. 3, in operation 601, a session is connected betweenthe remote application server 100 and the subscriber terminal device210. The session connection between the remote application server 100and the subscriber terminal device 210 may be performed by transmittinga session connection request from the subscriber terminal device 210 tothe remote application server 100.

In operation 602, the remote application server 100 requests thesubscriber terminal device 210 for state information.

The state information may be information associated with the subscriberterminal device 210 when the subscriber terminal device 210 performs apredetermined function in response to the control command received fromthe remote application server 100.

For example, the state information may include at least one ofresolution information of a display device interacting with thesubscriber terminal device 210, display screen rotation information,device information such as an input device interacting with thesubscriber terminal device 210, and service subscription information.

Depending on embodiments, operation 602 may be performed by transmittinga session access request and state information from the subscriberterminal device 210 to the remote application server 100 together withthe session connection between the remote application server 100 and thesubscriber terminal device 210 in operation 601.

In operation 603, the subscriber terminal device 210 generates stateinformation in response to the state information request. In operation604, the subscriber terminal device 210 transmits the generated stateinformation to the remote application server 100.

In operation 605, the remote application server 100 analyzes thereceived state information. In operation 606, the remote applicationserver 100 generates a control command including at least one of arendering control command for controlling a rendering at the subscriberterminal device 210 with respect to at least one of content and a UIresource and a terminal control command for controlling the subscriberterminal device 210, based on the analyzed state information.

In operation 607, the remote application server 100 transmits thegenerated control command to the subscriber terminal device 210.

The subscriber terminal device 210 controls at least one of a request tothe UI resource storage 420 for a UI resource and a request to thecontent storage 410 for content, in response to the control commandreceived from the remote application server 100.

In detail, in operation 608, the remote application server 100 requeststhe content storage 410 to transmit the content in response to thecontrol command received from the remote application server 100.

The content may include video content, audio content, a real-time TVbroadcasting program, a program on demand, SNS information, a chatmessage, a product, and an application.

Depending on embodiments, the content may include a format correspondingto a predetermined protocol such as an MPEG-2 transport packet, anMPEG-4, and a DVB

According to another embodiment, content may be content divided using apredetermined method. For example, when the content is real-timebroadcasting content, the content storage 410 may acquire broadcastingcontent, may divide the acquired broadcasting content using apredetermined method, and may store the divided broadcasting content.

In operation 609, the subscriber terminal device 210 requests the UIresource storage 420 to transmit the UI resource in response to thecontrol command received from the remote application server 100.

The UI resource may be configured using at least one of a webpage, abitmap of an application, and a graphic primitive of the application.

Depending on embodiments, the UI resource may provide a user interfacefor receiving an external user command to control a provider service andthe subscriber terminal device 210.

The subscriber terminal device 210 receives at least one of the contentand the UI resource in operation 610, and determines whether a commandto render the local UI resource is included in the control commandreceived from the remote application server in operation 611.

When the command to render the local UI resource is not included in thecontrol command received from the remote application server 100 inoperation 611, the subscriber terminal device 210 renders at least oneof the UI resource and the content respectively corresponding to the UIresource request and the content request in operation 612.

Conversely, when the command to render the local UI resource is includedin the control command received from the remote application server 100in operation 611, the subscriber terminal device 210 renders at leastone of the UI resource and the content respectively corresponding to theUI resource request and the content request and the local UI resourceextracted from a local UI storage in operation 613.

The local UI resource may be a user interface frequently interactingwith the user and requiring a quick responsiveness. For example, thelocal UI resource may be a UI resource corresponding to an EPG. The EPGmay display schedules of a broadcasting program on a display screen. Auser, for example, a viewer may select a desired program through theEPG, or may search for a desired program through a standard such as atime, a title, a channel, and a genre, using the subscriber device 200.

On the contrary, the UI resource stored and maintained in the UIresource storage may be a user interface that is infrequently used bythe user or is beyond the performance of the subscriber terminal device210.

FIG. 4 is a flowchart illustrating a process of providing cloud basedUIs through a remote application server in a system for providing cloudbased UIs according to an embodiment of the present invention.

Referring to FIG. 4, in operation 710, the remote application servercollects state information about a subscriber terminal device.

Operation 710 may include an operation in which the remote applicationserver connects a session with the subscriber terminal device. Thesession connection may be performed by transmitting a session connectionrequest from the subscriber terminal device to the remote applicationserver.

In operation 720, the remote application server analyzes the collectedstate information.

For example, operation 720 may be an operation of analyzing informationfor performing a function of the subscriber terminal device such as areception of content and a UI resource and processing of a user input.

In operation 730, the remote application server generates a controlcommand based on the analyzed state information.

Operation 730 may be an operation of controlling a control commandincluding a rendering control command for controlling a rendering at thesubscriber terminal device with respect to at least one of the contentand the UI resource based on the analyzed state information.

Depending on embodiments, operation 730 may be an operation ofgenerating a control command including a terminal control command forcontrolling the subscriber terminal device.

FIG. 5 is a flowchart illustrating a process of providing cloud basedUIs through a subscriber terminal device of a system for providing cloudbased UIs according to an embodiment of the present invention.

Referring to FIG. 5, in operation 810, the subscriber terminal devicegenerates state information in response to a state information requestreceived from a remote application server.

The state information may be information associated with the subscriberterminal device when the subscriber terminal device performs apredetermined function in response to a control command received fromthe remote application server.

In operation 820, the subscriber terminal device receives a controlcommand corresponding to the state information from the remoteapplication server, and controls at least one of a UI resource requestto a UI resource storage and a content request to a content storage inresponse to the received control command.

The content may include video content, audio content, a real-time TVbroadcasting program, a program on demand, SNS information, a chatmessage, a product, and an application.

Depending on embodiments, content may include a format corresponding toa predetermined protocol such as an MPEG-2 transport packet, an MPEG-4,and a DVB.

Also, according to another embodiment, the content may be contentdivided using a predetermined method. For example, when content isreal-time broadcasting content, the content storage may acquirebroadcasting content, may divide the acquired broadcasting content usinga predetermined method, and may store the divided broadcasting content.

The UI resource may be configured using at least one of a webpage, abitmap of an application, and a graphics primitive of the application.

Depending on embodiments, the UI resource may include a user interfacefor receiving an external user command for controlling a providerservice and the subscriber terminal device.

In operation 830, the subscriber terminal device renders at least one ofthe UI resource and content respectively corresponding to the UIresource request and the content request received in operation 820.

In operation 840, the subscriber terminal device determines whether acommand to render a local UI resource is included in the control commandreceived from the remote application server.

When the command to render the local UI resource is not included in thecontrol command received from the remote application server in operation840, the subscriber terminal device renders at least one of the UIresource and the content respectively corresponding to the UI resourcerequest and the content request in operation 850.

Conversely, when the command to render the local UI resource is includedin the control command received from the remote application server inoperation 840, the subscriber terminal device renders at least one ofthe UI resource and the content respectively corresponding to the UIresource request and the content request and the local UI resourceextracted from the local UI storage in operation 860.

The local UI resource may be a user interface frequently interactingwith the user and requiring a quick responsiveness. For example, thelocal UI resource may be a UI resource corresponding to an EPG. The EPGmay display schedules of a broadcasting program on a display screen. Auser, for example, a viewer may select a desired program through theEPG, or may search for a desired program through a standard such as atime, a title, a channel, and a genre, using the subscriber device.

On the contrary, the UI resource stored and maintained in the UIresource storage may be a user interface that is infrequently used bythe user or is beyond the performance of the subscriber terminal device.

The above-described embodiments of the present invention may be recordedin non-transitory computer-readable media including program instructionsto implement various operations embodied by a computer. The media mayalso include, alone or in combination with the program instructions,data files, data structures, and the like. Examples of non-transitorycomputer-readable media include magnetic media such as hard disks,floppy disks, and magnetic tape; optical media such as CD ROM disks andDVDs; magneto-optical media such as floptical disks; and hardwaredevices that are specially configured to store and perform programinstructions, such as read-only memory (ROM), random access memory(RAM), flash memory, and the like. Examples of program instructionsinclude both machine code, such as produced by a compiler, and filescontaining higher level code that may be executed by the computer usingan interpreter. The described hardware devices may be configured to actas one or more software modules in order to perform the operations ofthe above-described embodiments of the present invention, or vice versa.

Although a few embodiments of the present invention have been shown anddescribed, the present invention is not limited to the describedembodiments. Instead, it would be appreciated by those skilled in theart that changes may be made to these embodiments without departing fromthe principles and spirit of the invention, the scope of which isdefined by the claims and their equivalents.

What is claimed is:
 1. A remote application server comprising: a memoryconfigured to store computer-readable instructions; and one or moreprocessors configured to execute the computer-readable instructions suchthat the one or more processors are configured to, collect stateinformation about a subscriber terminal device, analyze the stateinformation received, generate a control command based on the analyzedstate information, the control command including at least one of arendering control command for controlling a rendering at the subscriberterminal device with respect to at least one of content and a userinterface (UI) resource, and a terminal control command for controllingthe subscriber terminal device, and transmit the rendering controlcommand to control the subscriber terminal device to enable thesubscriber terminal device to request a media storage for at least oneof the content and the UI resource, the media storage being separatefrom the remote application server.
 2. The remote application server ofclaim 1, wherein the one or more processors are further configured totransmit the rendering control command to the subscriber terminaldevice.
 3. The remote application server of claim 2, wherein the one ormore processors are further configured to transmit the rendering controlcommand to the subscriber terminal device to enable the subscriberterminal device to extract a local UI resource from a local UI storageincluded in the subscriber terminal device in response to the renderingcontrol command, and to render at least one of the content, and the UIresource, and the extracted local UI resource.
 4. The remote applicationserver of claim 1, wherein the one or more processors are configured totransmit the rendering control command to the subscriber terminal deviceover a network to enable the subscriber terminal device to perform atleast one of a terminal initialization, a software upgrade, and asession connection, and a session block in response to the terminalcontrol command.
 5. The remote application server of claim 1, whereinthe state information comprises at least one of resolution informationof a display device interacting with the subscriber terminal device,display screen rotation information, device information of an inputdevice interacting with the subscriber terminal device, and servicesubscription information; and the one or more processors are furtherconfigured to transmit a state information request to the subscriberterminal device, and receive the state information transmitted from thesubscriber terminal device in response to the state information request.6. A subscriber terminal device comprising: a memory configured to storecomputer-readable instructions; and one or more processors configured toexecute the computer-readable instructions such that the one or moreprocessors are configured to, generate state information in response toa state information request received from a remote application server ora state information provided by a user, send a request to a mediastorage for at least one of a user interface (UI) resource and content,and receive at least one of the UI resource and the content in responseto the state information request, the media storage being separate fromthe remote application server, control the request to the media storagein response to a control command received from the remote applicationserver, and receive and render at least one of the content and the UIresource.
 7. The subscriber terminal device of claim 6, furthercomprising: a local UI storage configured to store and manage a local UIresource, wherein the one or more processors are further configured toreceive the local UI resource from the local UI storage, and render thereceived local UI resource.
 8. The subscriber terminal device of claim7, wherein the one or more processors are configured to extract thelocal UI resource from the local UI storage in response to the controlcommand, and render the at least one of the received content, thereceived UI resource, and the extracted local UI resource.
 9. A methodof providing cloud based user interfaces (UIs) using a remoteapplication server, the remote application server including a memoryconfigured to store computer-readable instructions and one or moreprocessors configured to execute the computer-readable instructions, themethod comprising: collecting, by the one or more processors, stateinformation about a subscriber terminal device; analyzing, by the one ormore processors, the collected state information; generating, by the oneor more processors, a control command based on the collected stateinformation, the control command including, at least one of a renderingcontrol command for controlling a rendering at the subscriber terminaldevice with respect to at least one of content and a UI resource, and aterminal control command for controlling the subscriber terminal device;and transmitting, by the one or more processors, the rendering controlcommand to control the subscriber terminal device to enable thesubscriber terminal device to request a media storage for at least oneof the content and the UI resource, the media storage being separatefrom the remote application server.
 10. A method of providing cloudbased user interfaces (UIs) associated with a subscriber terminaldevice, the subscriber terminal device including a memory configured tostore computer-readable instructions and one or more processorsconfigured to execute the computer-readable instructions, the methodcomprising: generating, by the one or more processors, state informationin response to a state information request received from a remoteapplication server; receiving, by the one or more processors, a controlcommand corresponding to the state information from the remoteapplication server; controlling a request to a media storage for atleast one of a UI resource and content in response to the receivedcontrol command, the media storage being separate from the remoteapplication server; and rendering at least one of the content and the UIresource associated with the request to the media storage.
 11. Anon-transitory computer-readable recording medium storing a computerprogram, which when executed by a computer, configures a computer toperform the method according to any one of claims 9 and 10.